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Abstract 

Introduction: Social exclusion is considered a major factor in the causation and maintenance of health inequalities, but its 
measurement in health research is still in its infancy. In the Netherlands the Institute for Social Research (SCP) developed an 
instrument to measure the multidimensional concept of social exclusion in social and economic policy research. Here, we 
present a method to construct a similar measure of social exclusion using available data from public health surveys. 

Methods: Analyses were performed on data from the health questionnaires that were completed by 20,877 adults in the 
four largest cities in the Netherlands. From each of the four questionnaires we selected the items that corresponded to 
those of the SCP-instrument. These were entered into a nonlinear canonical correlation analysis. The measurement 
properties of the resulting indices and dimension scales were assessed and compared to the SCP-instrument. 

Results:T\ne internal consistency of the indices and most of the dimension scales were adequate and the internal structure 
of the indices was as expected. Both generalisabiliy and construct validity were good: in all datasets strong associations 
were found between the index and a number of known risk factors of social exclusion. A limitation of content validity was 
that the dimension "lack of normative integration" could not be measured, because no relevant items were available. 

Conclusions: Our findings indicate that a measure for social exclusion can be constructed with available health 
questionnaires. This provides opportunities for application in public health surveillance systems in the Netherlands and 
elsewhere in the world. 
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Introduction 

Social exclusion is generally considered as one of the social 
determinants of health and a major factor in the causation and 
maintenance health inequalities [1—3]. Social exclusion is a broad 
term that refers to the inability of certain groups or individuals to 
participate fully in society. The World Health Organization 
defines social exclusion as "dynamic multidimensional processes 
driven by unequal power relationships interacting across four main 
dimensions - economic, political, social and cultural - and at 
different levels including individual, household, group, communi- 
ty, country and global levels" [4]. Important features of social 
exclusion are multi-dimensionality, relativity (i.e. social exclusion is 
context specific) and agency [5] . Agency refers to the fact that the 
excluding is done by someone or something, which can be the 
government or private institutions, the social environment or the 
individual itself. It is common that exclusion processes in one 
dimension affect those in other dimensions [2,6,7]. For example 
the loss of paid employment may lead to loss of social contacts and 
loss of income, which in turn may result in debts, poor housing, 
insecure living environment or reduced access to health care [6]. 
All these factors increase the risk of health problems directly or 
indirectly. In addition the experience of being excluded affects 



health negatively [1,2]. Health risks thus tend to accumulate in 
socially excluded individuals and groups. 

In the Netherlands, Community Health Services are responsible 
for public health monitoring at the local level. At least once every 
four years they conduct routine public health surveys among the 
adult population. The questionnaires that are used for this cover a 
broad spectrum of health outcomes and determinants. In addition 
to mandatory questions on a national level, topics can be included 
to address local policy priorities. If available, validated and 
standardised measures are used [8]. Measurement of social in 
these health surveys is desired, but acceptable measurement 
instruments are lacking. 

Recently, the Netherlands Institute for Social Research | SCP 
(SCP) has developed an instrument to measure social exclusion in 
social and economic policy research [9,10]. Based on an extensive 
literature review, the SCP has first defined and then operationa- 
lised the concept of social exclusion [7] . The definition is rooted in 
two scientific traditions i.e. the French tradition, which focuses on 
the extent to which people are integrated into society and 
connected to others (socio-cultural exclusion); and the Anglo- 
Saxon tradition, which emphasises relative deprivation, the notion 
that people or groups consider themselves disadvantaged com- 
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pared to others with similar characteristics (their reference group). 
Nowadays, research within the Anglo-Saxon tradition is focused 
on a more 'objective' approach in terms of social indicators that 
measure differences in socio-economic status and rights (structural- 
economic exclusion). [9]. 

The SCP definition of social exclusion distinguishes two forms 
of social-cultural exclusion: "lack of normative integration" and 
"limited social participation" and two forms of structural- 
economic exclusion i.e. "material deprivation" and "inadequate 
access to basic social rights". A person is socially excluded to some 
extent if there is accumulation of deficiencies on or more of these 
four dimensions. The greater the number of deficiencies and the 
larger these deficiencies are, the higher the degree of social 
exclusion. See Table 1 for the operationalisation of the dimen- 
sions. To construct an instrument to measure the four dimensions, 
the SCP administered a questionnaire to a sample of the Dutch 
population. The initial questionnaire consisted of 232 items 
derived from previous SCP research, literature, focus groups and 
cognitive tests. For each of the dimensions, a subscale containing 
three to four items was constructed by using nonlinear canonical 
correlation analysis. Together, these 15 items make a general 
index that reflects the underlying construct of social exclusion. The 
general index measures the degree of social exclusion at the 
individual level, with a higher index score for persons deprived 
simultaneously on several dimensions. [9,10]. 

Although the SCP measurement instrument for social exclusion 
has been adapted and validated for the Dutch context, its 
suitability for routine public health surveys is limited. The 
Community Health Services consider the measure, with 15 items, 
too long to include in their health questionnaires. The total 
number of items that can be included in the questionnaires is 
limited and there is fierce competition between topics. Moreover, 
there is substantial overlap of the SCP-questionnaire of Social 
Exclusion with current topics of the health surveys, such as 
loneliness, social capital, financial situation and housing. This last 
observation prompted us to explore whether the multidimensional 
concept of social exclusion can validly be approximated with items 
from the health questionnaires that are already used in the public 
health surveys in the Netherlands. We had access to the data 
collected in the surveys of 2008 with health questionnaires from 
the Community Health Services of the four largest cities in the 
Netherlands. Our ultimate goal is to develop a nationally validated 
and standardised measure to monitor social exclusion in routine 
public health surveys. 



Methods 

Ethics Statement 

Ethical approval was not required as this study relied on 
secondary anonymised data collected in the context of performing 
statutory tasks (Public Health Act of the Netherlands), in strict 
accordance with the national standard. At no point in time did the 
datasets contain direct identifiers. Codes to track response were 
removed from paper questionnaires directly upon receipt and 
processed separately, as were online access codes. The risk of re- 
identification of individuals from indirect identifiers such as age (in 
years) and sex, was very low. 

The datasets are freely available for non-commercial research 
purposes. 

Data Source and Participants 

We conducted secondary analysis on data of four public health 
surveys that were collected in 2008 by the local Community 
Health Services in the cities of Amsterdam, Rotterdam, The 
Hague and Utrecht, using a uniform research methodology. The 
content of the questionnaires was only dissimilar for items that 
were selected according to local policy priorities. 

In each city an a select sample was drawn from the non- 
institutionalised population aged 16 years and older, stratified by 
district, neighbourhood, age and ethnicity. A total of 42,686 
persons received a questionnaire by mail. These questionnaires 
could be filled out in writing or via the Internet. Non-responders 
received a reminder after two weeks. In addition, difficult to reach 
groups such as non-western immigrants and residents of deprived 
neighbourhoods were contacted after four weeks by telephone or 
home visit and invited to participate by mail or personal interview 
in the language preferred by the respondent. For Turkish 
respondents, the main non-Dutch speaking minority in the 
Netherlands, a translated questionnaire was available. 

The overall response rate was 50% (20,877 respondents) and 
ranged between 47% in Rotterdam and 54% in Utrecht. Despite 
the intensive follow-up, the response was lower among difficult to 
reach groups. Through oversampling these groups were still well 
represented in each of the four studies [1 1] . In line with the age 
standard for public health surveys in the Netherlands, we limited 
our analyses to respondents aged 19 years and older (19,658 
respondents). 



Table 1. Operationalisation of the four dimensions of social exclusion. [9,10]. 



Dimension of social exclusion 


Operationalisation 


Lack of normative integration 


Non-compliance with core values of society. In the Dutch context, 

this relates to issues like "having no respect for other people", 

"not saying 'thank you' when receiving change" 

or "putting out your garbage on a Tuesday when it's 

only allowed on a Wednesday "*. 


Limited social participation 


Social isolation, limited participation in 

social networks and inadequate social involvement. 


Material deprivation 


Deficits that people experience as shown by debts and 
the absence of certain basic goods and services, such as a 
washing machine or a daily hot meal. 


Inadequate access to basic social rights 


Inability to exercise the rights people normally have. 
This dimension is operationalised as having access to 
adequate health care, sufficient education and a proper living environment. 



*The quotations are from participants in the focus groups organised by the SCP [10] 
doi:1 0.1 371 /joumal.pone.0098680.t001 
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Figure 1. Measuement model for social exclusion. The model illustrates the construction of a composite index based on selected sets of 
variables, that each measures one of the four dimensions of social exclusion. 
doi:1 0.1 371 /journal.pone.0098680.g001 



Construction of Measurement Instrument 

Following the SCP procedures, we applied non-linear canonical 
correlation analysis (OVERALS) to the different sets of survey 
data. OVERALS is an optimal scaling technique developed by the 
University of Leiden, which is available in the SPSS software 
package. Canonical correlation analysis is often used to explore 
relationships between two sets of variables, an independent and 
dependent set, and to reduce the dimensionality to a few linear 
combinations of the measures under study [13]. In the context of 
the current study, we used canonical correlation analysis to 
construct a composite index based on selected sets of variables, 
each measuring one of the four dimensions of social exclusion 
(Figure 1). OVERALS differs in three ways from standard linear 
canonical correlation analysis: variables can be nominal, ordinal or 
interval; there can be more than two sets of variables; and instead 
of maximizing correlations between the variable sets, the sets are 
compared to an unknown compromise set that is defined by the 
object scores [13]. If the correlation between the sets is sufficient, it 
is assumed that these sets refer to an underlying concept. [9, 1 2] . 

From each dataset we selected items matching one of the four 
dimensions of social exclusion as operationalised by the SCP. All 



items were coded in the same direction, so that a high score refers 
to more exclusion. Records with one or more missing values on all 
dimensions were removed from the analyses. As the items in The 
Hague and Rotterdam datasets matched exactiy, these were 
merged. The analysis thus resulted in three indices: Amsterdam 
(Indexl), Rotterdam/The Hague (Index2) and Utrecht (Index3). 

Initially all items were entered in the OVERALS analysis. Using 
category quantifications, the most appropriate measurement level 
of the items was chosen. Similar to the SCP method [9,12], items 
with component loadings less than 0.300 were removed one by 
one, starting with lowest correlations. Subsequendy, items with 
weights less than 0.100 were removed, as well as items that scored 
in the opposite direction. Finally, scores on the subscales were 
computed using category quantifications and weights (for formulas 
see [12]). 

Measurement Properties 

We used a series of methods to evaluate the measurement 
properties of the constructed indices, i.e. content validity, internal 
consistency, internal structure and construct validity. 



Table 2. Sociodemographic characteristics of the respondents per sample (unweighted). 







Total 


Amsterdam 
sample 


Rotterdam 
sample 


The Hague 
sample 


Utrecht 
sample 


P 




(N = 19,658) 


(N = 6,511) 


(N = 5,127) 


(N = 4,220) 


(N = 3,800) 




Sex (male, %) 


43.3 


41.1 


45.8 


44.2 


42.5 


.000* 


Age (mean, SD) 


51.0 (19.1) 


58.2 (20.0) 


49.3 (17.6) 


48.8 (17.6) 


43.3 (16.9) 


.000" 


Non-Western ethnic 
background (%) 


20.4 


19.1 


23.4 


24.8 


13.7 


.000* 


Low educational level (%) # 


16.1 


19.8 


15.8 


14.8 


11.5 


.000* 


Living in a deprived neighbourhood (%) 


34.2 


39.6 


30.7 


36.2 


27.2 


.000* 



*The P values were obtained by using Pearson's Chi Square analysis. 
^The P value was obtained by using One-way Anova F-test. 
#No education and primary school. 
doi:1 0.1 371 /joumal.pone.0098680.t002 
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Table 3. Summary of items which were incorporated in the SCP index or in one of the three constructed indices, by dimension 
and index. 





Dimension 


Items SCP 


Items health 
questionnaires 


Index! 

(Amsterdam)* 


Index 2 

(Rotterdam/The 
Hague)* 


Index3 
(Utrecht)* 


Dimension 1: 
'Limited social 
participation' 


There are people 

who genuinely understand me 


There are enough people 
1 feel close to 


+ 


+ 






1 feel cut off from other people 


1 experience a general 
sense of emptiness 


+ 


+ 


+ 




There are people with whom 
1 can have a good conversation 


There is always someone 
1 can talk to about my 
day-to-day problems 


+ 




+ 




1 have contact 
with neighbours 


Little contact with neighbours 
and people in the street 






+ 






There are plenty of people 
1 can lean on when 1 have 
problems 


+ 


+ 


+ 


1 miss the pleasure of the + + + 
company of others 






1 often feel rejected 


+ 


+ 


+ 


1 miss having people around - - + 


Dimension 2: 

'Material 

deprivation' 


1 have enough money to heat 
my home 










1 have enough money for club 
memberships 


1 have enough money to visit 
others 


1 have enough money to meet 
unexpected expenses 






Had difficulty past year 
getting by on the 
household income 


+ 


+ 


+ 


Current financial situation of + + + 
the household: have 
to go into debt 


Dimension 3: 
'Inadequate 
access to basic 
social rights' 


We all get on well in our 
neighbourhood 


People in this neighbourhood 
generally do not get 
along with each other 




+ 


+ 




1 am satisfied with 

the quality of my home 


Degree of satisfaction 
with housing 




+ 


+ 


1 didn't receive a medical 
or dental treatment 


The people in my neighbourhood . + 
help each other 






People in this neighbourhood 
can be trusted 




+ 


+ 


1 prefer not to socialise with . + + 
people in my neighbourhood 






Feeling unsafe during the day 




+ 




Feeling unsafe in the . + 
evening and at night 






Need for information 

or assistance: stress reduction 






+ 






Need for information 
or assistance: coping 
with depression 






+ 






Need for information 

or assistance: coping with 

loneliness 






+ 
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Table 3. Cont. 



Index2 

Items health Index! (Rotterdam/The Index3 

Dimension Items SCP questionnaires (Amsterdam)* Hague)* (Utrecht)* 

Need for information . . + 

centre on care and welfare 

Dimension 4: I give to good causes (no) 

lack of 

normative 

integration' 

I sometimes do ... 
something for my 
neighbours (no) 

I put glass items in ... 
the bottle bank (never) 

Work is just a way of ... 
earning money (agree) 



The table lists the items that became included in one of the three constructed indices as well as the items that form part of the SCP index. The SCP index is is shown for 
reference purposes only. Per index the following information is displayed: 

* + retained in OVERALS analysis; — removed in OVERALS analysis; item not available in respective dataset. 
doi:1 0.1 371 /journal.pone.0098680.t003 



To assess the content validity, we examined whether the 
constructed indices encompassed all dimensions of social exclusion 
and whether the included items were representative for the 
dimensions they were expected to measure. In addition, we 
inspected the distributions of the index scores and compared these 
with the SCP index. To assess the internal consistency of the 
indices we calculated the canonical correlation, which measures 
the degree to which the items contribute to the underlying latent 
variable. A canonical correlation of 0.300 was defined as the lower 
limit to ensure reliability of the indices [9,13]. Cronbach's alpha 
was used to measure the internal consistency of the subscales, 
where we considered ots0.70 to be good [14]. 

For the assessment of the internal structure of the instruments, 
we computed the intercorrelations of the subscales and the general 
indices. Construct validity was assessed by testing predefined 
hypotheses [14]. For this purpose we selected a number of items 
that measure risk factors and correlates of social exclusion, derived 
from previous SCP research [7,10]. None of these were selected 
for the construction of the indices. The factors and correlates 
included were: 

— Sociodemographic variables: low educational level; non-Western 
ethnic background; single-parent; living alone; unemployed 
and/or recipient of social security or disability benefits; no paid 
job; income below modal (1,700 Euros net per month); and 
living in a deprived neighbourhood; 

— Health related factors: fair or poor self-rated health (versus good or 
very good); being diagnosed with at least one of eighteen 
chronic conditions; impaired in daily activities at home, at 
school, at work or in their leisure time due to chronic 
conditions (light to strong) and high risk for anxiety and 
depression disorder (score 30 or higher on Kessler psycholog- 
ical distress scale); 

— Variables on self-reliance: low perceived life control (Pearlin & 
Schooler Mastery Scale, score <= 19); and need of help to 
complete the health questionnaire. 

We expected higher levels of social exclusion in these groups. 
The construct validity was considered satisfactory if at least 75% of 



the associations were in correspondence with these expectations 
[14]. 

Index Selection 

Based on the results of the measurement properties analyses, we 
identified the best performing index. Generalisability of this index 
was subsequendy examined by testing the items in the other 
datasets, where available. 

Statistical Analysis 

Analyses were performed with SPSS 19.0. Group differences 
were tested with Pearson Chi Square test (categorical variables) or 
Anova F-test (continuous variables). Linear regression analyses 
were used to assess relationships between risk factors and social 
exclusion indices. 

Results 

Characteristics of the Study Populations 

Table 2 shows the sociodemographic characteristics of respon- 
dents in the four cities. As can be seen in Table 2, risk groups for 
social exclusion such as persons of non-Western origin, lower 
educated persons and persons living in deprived neighbourhoods 
were well represented in all four samples. Significant differences 
were found between the samples with regard to sex, age, ethnical 
background, educational level and the proportion of individuals 
living in deprived neighbourhoods. The observed differences 
reflect demographic variation between the four cities and the 
degree of oversampling in difficult to reach groups. 

Construction of the Measurement Instruments 

In the four health questionnaires, we identified 1 1 items that 
matched the SCP operationalisation of the dimension limited 
social participation. All of these items belong to the loneliness scale 
of De Jong Gierveld [15]. In addition, in the Utrecht questionnaire 
3 items were available on the frequency of social contacts. 

For the measurement of the dimension 'material deprivation' 2 
items were available in each of the cities. These items relate to the 
financial situation of the household and difficulties in making end 
meets. 
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Table 5. Pearson correlations coefficients between general indices and dimension subscales, SCP and the four cities. 









Index2 






SCP 


Indexl 


Rotterdam & The 


Index3 


Correlation between: 


Index* 


Amsterdam 


Hague 


Utrecht 


General index x dimension 1 


0.76 


0.78* 


0.76* 


0.82* 


General index x dimension 2 


0.70 


0.79* 


0.72* 


0.68* 


General index x dimension 3 


0.77 




0.73* 


0.81* 


Dimension 1 x dimension 2 


0.35 


0.30* 


0.34* 


0.33* 


Dimension 1 x dimension 3 


0.43 




0.39* 


0.55* 


Dimension 2 x dimension 3 


0.44 




0.34* 


0.38* 



*p<.01. 

a Vrooman and Hoff [10]. 

doi:1 0.1 371 /joumal.pone.0098680.t005 



We found no items to measure 'inadequate access to basic social 
rights' in the Amsterdam sample. In the questionnaires of The 
Hague, Rotterdam and Utrecht we found 18 items that matched 
the operationalisation of this dimension by the SCP, including 5 
items on neighbourhood cohesion, 2 items on satisfaction with 
housing and living environment and 1 1 items on environmental 
and nuisance problems in the neighbourhood. The questionnaires 
from The Hague and Rotterdam included 2 additional items on 
feeling unsafe during the day or night. From the Utrecht 
questionnaire 26 additional items were selected that related to 
the presence of moisture or mold in the home, to the need for 
information or assistance with health problems and to the need for 
facilities in the neighbourhood. 

Items for the dimension 'lack of normative integration' were not 
available in any of the questionnaires. 

With the aforementioned 62 items, three indices were 
constructed: Indexl was based on the items from the Amsterdam 
questionnaire, Index2 on the items from the Rotterdam and The 
Hague questionnaires combined and Index3 on the items from the 
Utrecht questionnaire. In Indexl, 8 of the 13 items were retained, 
in Index2 14 of the 33 items and in Index3 17 of the 57 items. 
With one exception, items were removed because of low 
component loadings or low weights. The item on 'mold and 
moisture in the home' from the Utrecht questionnaire was 
removed because of a reverse association with the other items. 
The centroid plots generated by the OVERALS analyses are given 
in Figures SI, S2 and S3. 

Table 3 shows the selected items per index and per dimension. 
From the 14 items that were present in two or more datasets, 10 
were included in all relevant indices and 4 items were included in 
some indices but not in others. For example, the item 'There are 
enough people I feel close to' was incorporated in the indices 2 and 
3 but not in Index3. Instead, Index3 contained the item 'I miss 
having people around', which was absent in the indices 1 and 2. 

Measurement Properties 

Content validity. To examine the degree to which the 
indices cover the multidimensional concept of social exclusion, we 
compared, for each dimension, the items in the constructed indices 
with those in the SCP index. The dimension 'limited social 
participation' of the SCP index comprises items on social isolation 
and on participation in social networks. From Table 3 we can see 
that all three constructed indices included items on social isolation, 
but only Index3 contained an item on participation in social 
networks i.e. contacts with neighbours. In the dimension 'material 
deprivation' the SCP index includes items on the financial 



situation of the household and on the lack of basic goods and 
services. The three constructed indices did contain 2 items on the 
financial situation of the household, but items on the lack of basic 
goods and services, were absent in all three indices. In the 
dimension 'inadequate access to basic social rights' the SCP index 
contains aspects of good living environment and access to health 
care. Index2 and Index3 contained similar items on good living 
environment, but only Index3 contained additional items on 
access to healthcare. These items however, referred to the need for 
information or assistance and not the actual lack of access, as does 
the SCP questionnaire. 

As floor or ceiling effects may limit the content validity [14], we 
examined the frequency distributions of the three indices. All three 
distributions were right-skewed, which corresponds well with the 
distribution of the SCP index and is consistent with the 
expectation that a large part of the population is not excluded, 
while the degree of exclusion at the right end of the scales varies 
widely. 

Internal consistency. Table 4 shows the findings on the 
internal consistency of the indices and subscales. The canonical 
correlations of three constructed indices ranged from 0.35 (Indexl) 
to 0.44 (Index3), which is sufficient. Index2 and Index3 had even 
higher canonical correlations than the SCP index (r d = 0.38). The 
Cronbach's alphas of the transformed subscales were good for 
dimensions 1 and 2. For dimension 3 Cronbach's alphas were 0.68 
(Index2) and 0.65 (Index3). In the SCP study Cronbach's alphas 
were not calculated. 

Internal structure. Table 5 provides the correlations 
between the subscales and the general indices and between the 
subscales themselves. The correlations between the subscales and 
the general indices ranged from 0.68 to 0.82, and were similar to 
those of the SCP index. As expected, the correlations between the 
subscales were weaker than with the general indices. They ranged 
from 0.33-0.55, which is in line with the internal structure of the 
SCP index. 

Construct validity. As can be seen from Table 6 all 
predefined hypotheses were confirmed. Without exception, the 
indices were positively associated with the selected risk factors and 
correlates. Regression coefficients showed the expected direction 
and were statistically significant (p<0.01). Persons with lower 
income were more often socially excluded than people with a 
higher income. People in poor health, persons of non- Western 
origin and those with low perceived self control were also at higher 
risk. The same holds for lower educated persons, people living in 
deprived neighbourhoods, jobless adults, single persons and single 
parents. In contrast to the SCP, we also found significant 
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associations with low labour market position and need of assistance 
in filling in the questionnaire. In general, the associations found in 
the current research were stronger than in the SCP study. 

Index Selection and Generalisabilty 

When compared with the other indices, Index3 performed best 
on content validity and performed equally well with regard to 
internal consistency, internal structure and construct validity. For 
that reason we continued our analysis with Index3. Generalisa- 
bility of the items from Index3 was tested in the datasets of 
Rotterdam/The Hague and Amsterdam, where available. We 
performed analyses with 2 and 3 sets of variables. In all cases, the 
OVERALS analysis yielded indices with comparable measure- 
ment properties i.e. a distribution of index scores, internal validity, 
internal structure and construct validity that was similar to Index3. 

Discussion and Conclusions 

Our approach to construct a scale for social exclusion based on 
items from routine public health surveys was successful in all four 
cities as far as relevant items were available in the surveys. Data 
reduction with canonical correlation analysis yielded fairly similar 
selections of items consistently with the original SCP index. This 
corroborates the assumption that similar constructs were mea- 
sured. Both the general indices and the underlying dimension 
scales had good internal consistencies, with the exception of the 
dimension scale 'inadequate access to basic social rights'. In line 
with the SCP index, the internal structure of our indices reflected 
the multidimensional character of the concept social exclusion. 
Moreover, the indices demonstrated strong associations with risk 
factors and correlates, which may be considered as a confirmation 
of the construct validity of the indices. On the whole, Index3, 
based on the Utrecht dataset, performed most consistent due to 
better content validity in the dimensions 'limited social participa- 
tion' and 'inadequate access to basic social rights'. The OVER- 
ALS analyses demonstrated good generalisability to the other 
cities. 

The measurement of a multidimensional construct such as 
social exclusion provides methodological challenges for researchers 
[3]. By using nonlinear canonical correlation analysis (OVER- 
ALS), we were able to construct an instrument which not only 
expressed the degree of social exclusion in a single index score, but 
also allowed us to simultaneously assess the underlying dimensions. 
The selection of items and attribution of weight factors were not 
defined a priori but were determined empirically by the OVER- 
ALS technique, and thus added credibility to our findings. 

In our research, we had the advantage of an available well- 
defined and established definition and operationalisation of social 
exclusion used in social and economic policy research. The 
definition, was based on extensive literature and empirical 
research [7,10,16], and was validated by the SCP in various 
Dutch population groups such as the elderly and children [17-19], 
and in several European countries [20]. 

Due to the number and redundancy of items, the measurement 
instrument developed by the SCP [10], however, is difficult to 
accommodate in routine pubic health monitoring. Undue length 
and overlap with available questions may lead to lower respondent 
acceptance and lower response rates. This is particularly pertinent 
in the Netherlands where response rates are low and decreasing 
over time [21]. With our approach of constructing a measurement 
instrument based on available routine public health survey data, 
we managed to address the issues of length and overlap and 
created an efficient and acceptable instrument while ensuring its 
validity and reliability. 



The usability of the constructed instrument is not confined to 
the studied cities. The use of multiple datasets allowed us to 
replicate the measurement properties in other populations, which 
improved the generalisability of our findings beyond the popula- 
tion in which the instrument was developed. This makes it a 
promising instrument for other cities and countries as well. 

Further strengths of our study are the large sample size, the 
broad representation of the study population and the intensive 
approach of hard-to-reach high risk groups. 

A limitation of our study is that the routine public health surveys 
used in this study did not contain items on the dimension 'lack of 
normative integration'. It has been reported previously that such 
items are not standardly available in (health) questionnaires [10]. 
Normative integration relates to the duties of social citizenship and 
is reflected in e.g. compliance with dominant values, social 
commitment and responsibility towards fellow citizens. Failure to 
comply with these obligations is as much a cause of social (self- 
)exclusion as are the rights associated with social citizenship [7] . As 
normative integration is considered an important theoretical 
dimension of social exclusion, we recommend to include in future 
research additional items from the validated SCP index, such as 
'giving to good causes' and 'sometimes doing something for one's 
neighbours' (Table 3). Although the other three dimensions were 
well represented in Index3, some improvements can be made. 
Items that could be included in the dimension 'material 
deprivation' are lack of basic goods and services and in the 
dimension 'inadequate access to basic social rights' items that refer 
to the actual lack of access to healthcare. 

Furthermore, we were not able to assess the concurrent validity 
of our indices. As the study was based on secondary data, we could 
not examine the agreement between the indices and the SCP 
index in the same dataset. However, the evidence suggests that the 
constructed indices will be closely interrelated with the SCP index, 
given the similarities in content and good agreement in 
measurement properties between the constructed indices and the 
SCP index. 

The main contribution of this paper is the development of a 
social exclusion index that can be measured reliably and validly 
with routine public health survey data. Until now, no generally 
accepted and validated instrument has been developed to measure 
social exclusion in health research [3,22—25], even though such an 
instrument is considered paramount to improve our understanding 
of how social exclusion influences health and health inequalities 
[2-4,22,26,27]. The index discussed in this article is not only 
relevant for the Netherlands, but may be applied in other public 
health surveillance systems as well, such as the Centers for Disease 
Control and Prevention National Health Interview Survey [28], 
the Health Survey for England [29] and the Italian risk factor 
surveillance system PASSI [30]. Once included in routine public 
health monitoring, large amounts of data will become available 
with which social exclusion can be quantified, risk groups 
identified and developments monitored over time. Relations with 
health outcomes and determinants can be assessed by combining 
social exclusion data with other health surveillance data. Such 
information is relevant from several perspectives. Social exclusion 
is considered an important determinant of health inequalities and 
offers a broader range of policy options than more simple concepts 
like low income and poverty [26,31,32]. Valid and reliable 
information can help policy makers to develop more effective 
policies to reduce health inequalities. Moreover, it can provide a 
baseline from which to monitor and assess the effects of policies 
and programmes [2,3,33]. Finally, the measurement of social 
exclusion can raise the profile and visibility of excluded groups and 
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draw attention to the diverse causes and consequences of social 
exclusion [24]. 

This study set out to explore whether the multidimensional 
concept of social exclusion can be measured with the health 
questionnaires that are currently used in the public health surveys 
in the Netherlands. This question can be answered positively. We 
succeeded in constructing a brief measure for social exclusion with 
good measurement properties and high acceptability, which is 
suitable for use in routine public health surveys. The use of this 
measure in other countries and regions will enable the develop- 
ment of effective policies and programmes to tackle health 
inequalities. 

Supporting Information 

Figure SI Centroid plots Index 1: Quadrants I and II (A); 
Quadrants III and IV (B). The Figures SI A and B show the 
centroid plots generated by a two dimensional Overals analysis on 
the Amsterdam dataset. Blue are centroids of variables in the set 
'Lack of social participation'; red are centroids of variables in the 
set 'Material deprivation'. The scales vary between figures. 
(TIF) 

Figure S2 Centroid plots Index2: Quadrants I and II (A); 
Quadrants III and IV (B). The figures S2 A and B show the 
centroid plots generated by a two dimensional Overals analysis on 
the Rotterdam/The Hague dataset. Blue are centroids of variables 
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in the set 'Lack of social participation'; red are centroids of 
variables in the set 'Material deprivation' and green are centroids 
of variables in the set 'Limited access to basic social rights'. The 
scales vary between figures. 
(TIF) 
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of social participation'; red are centroids of variables in the set 
'Material deprivation' and green are centroids of variables in the 
set 'Limited access to basic social rights'. The scales vary between 
figures. 
(TIF) 
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